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Abstract 



Q ■ We present a comprehensive investigation of e-entropy, h(e), in dynamical 

systems, stochastic processes and turbulence. Particular emphasis is devoted 
on a recently proposed approach to the calculation of the e-entropy based on 
the exit-time statistics. The advantages of this method are demonstrated in 
examples of deterministic diffusive maps, intermittent maps, stochastic self- 
affine and multi-affine signals and experimental turbulent data. Concerning 
turbulence, the multifractal formalism applied to the exit time statistics allows 
^-|- \ us to predict that h(e) ~ e~ 3 for velocity time measurement. This power law 

is independent of the presence of intermittency and has been confirmed by 
the experimental data analysis. Moreover, we show that the e-entropy density 
of a 3-dimensional velocity field is affected by the correlations induced by the 
sweeping of large scales. 
PACS: 05.45.+b 
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^ ■ I. INTRODUCTION 

sa : 

Many sciences, ranging from geophysics to economics, share the crucial problem of extracting 
information about the underlying dynamics of a system through the analysis of data time 
series [|TJ . In these investigations, a central role is played by the evaluation of the complexity 
degree of a string of data as a way to probe the underlying dynamics [@,f|. Since the 
pioneering works of Shannon on information theory entropy has been proposed as the 
proper mathematical tool to quantitatively address such a question. 

Nowadays, entropy constitutes a key-concept to answer questions ranging from the more 
conceptual aim to distinguish a pure stochastic evolution from a chaotic deterministic one 
to the more applied goal of quantifying the degree of predictability at varying the space- 
time resolution |5|-||. The latter question is evidently of primary importance, e.g., to set 
the proper resolution of the data accumulation rate in experimental settings or to efficiently 
compress data which have to be stored or transmitted. 
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The distinction between stochastic and deterministic chaotic evolution can be formalised by 
introducing the Kolmogorov- Sinai (KS) entropy, h KS [0. Let us consider a time series 
x t (with t = 1, . . . ,T) where, for simplicity, the time is discretised but x t is a continuous 
variable. By defining a finite partition of the phase-space, where each element of the partition 
has diameter smaller than e, and by recording for each t the symbol (letter) identifying the 
cell Xt belongs to, one can code the time series into a sequence of symbols out of a finite 
alphabet. Then, from the probabilities of words of length m (m- words) one can compute 
the m-block entropy. Finally, one measures the information-gain in going from m-words to 
(m + l)-words: in the limit of infinitely long words (m — > oo) and of arbitrary fine partition 
(e — ► 0) one obtains h KS , that is an entropy per unit time ||. The value of hxs characterises 
the process which has generated the time series. For example, in a continuous stochastic 
evolution, which reveals more and more unpredictable outcomes at increasing the resolution, 
the .K'S'-entropy is infinite. On the other hand, a regular deterministic signal is characterised 
by a zero i^S'-entropy, since it is completely predictable after a finite number of observations, 
at any given resolution. Between these two limiting finite positive value of h KS is the 

signature of a deterministic chaotic dynamics. The -fTS-entropy measures the growth rate 
of unpredictability of the evolution, which coincides with the rate of information acquisition 
necessary to unambiguously reconstruct the signal. However, the distinction between chaotic 
and stochastic dynamics can be troublesome in practical application (see || for a related 
discussion) . 

Indeed, only in simple, low dimensional, dynamical systems the hxs evaluation can be 
properly carried out. As soon as one has to cope with realistic systems, e.g. geophysical 
flows, the number of degrees of freedom is so large that it inhibits any definite statement 
based on the K S-entiopy evaluation. Moreover, even if one were able to compute the KS- 
entropy of those systems, many interesting features can not be answered by only knowing 
hxs- As a relevant example we mention the case of turbulence, the dynamics of which is 
characterised by a hierarchy of fluctuations with different characteristic times and spatial 
scales ||11|| . In this respect the i^S'-entropy is related only to the fastest time scale present 
in the dynamics. Therefore, to quantify the predictability degree depending on the range of 
scales and frequencies analysed, we need a more general tool 

In order to make a step to overcome these difficulties, we consider a scale-dependent quantity, 
namely the e-entropy, h(e), originally introduced by Shannon Q and Kolmogorov [D| to 
characterise continuous processes. It is remarkable that, in spite of its deep relevance for the 
characterisation of stochastic processes and non trivial dynamical systems, the e-entropy is 
not widely used in the physical community. Only recently, mainly after the review paper 
of Gaspard and Wang |7J and the introduction of the Finite Size Lyapunov Exponent |3J, 
there appeared some attempts in the use of the e-entropy. For this reason, in Section [[J we 
give a brief pedagogical review, aimed to introduce the reader to the e-entropy and (e, r)- 
entropy. Practically the (e, r)-entropy, h(e, r), is the Shannon entropy of time series sampled 
at frequency r -1 and measured with an accuracy e in the phase space. 
We will see that the analysis of the e-dependence of h(e) is able to highlight many dynamical 
features of very high- dimensional systems like turbulence as well as of stochastic processes 
|7|jT2|j. The determination of h(e,r) is usually performed, as already stated, by looking at 
the Shannon entropy of the coarse-grained dynamics on a (e, r) grid in phase-space. Unfor- 
tunately, this method suffers of so many computational drawbacks that it is almost unusable 
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in many interesting situations. In particular, it is very inefficient when one investigates phe- 
nomena arising from the complex interplay of many different spatial and temporal scales, 
the ones we are interested in. Therefore, here we resort to a recently proposed method 
14| based on the exit-time analysis, which has been demonstrated to be both practically 



and conceptually advantageous with respect to the standard one. In a few words, the idea 
consists in looking at a sequence of data not at fixed sampling time but at fixed fluctua- 
tion, i.e. when the signal is larger than some given threshold, e. This procedure allows a 
noticeable improvement of the computational possibility to measure the e-entropy. We give 
an ample demonstration of the advantages of this method in a number of examples ranging 
from one-dimensional dynamical systems, to stochastic (affine and multi-affine) processes 
and turbulence. 

As far as turbulence is concerned, we present both an application to experimental data 
analysis and a theoretical remark. Namely, we will see that from the computation of the 
e-entropy of turbulent flows one has a deep understanding of the spatial correlation induced 
by the sweeping of large scales on the smaller ones. In order to understand these features 
we also introduce and discuss a new stochastic model of turbulent flows which takes into 
account sweeping effects. 

The paper is organised as follows. In Section [TJ we briefly define the e-entropy and discuss its 
properties; we use a simple example which shows the conceptual relevance of this quantity 
together with the difficulties of its computation. In section [HI] we introduce the exit-time 
approach to the calculation of the e-entropy discussing in detail its theoretical and numerical 
advantages. In section |TV|, we discuss the use of the e-entropy in characterising intermittent 
low dimensional dynamical systems and stochastic (affine and multi-affine) processes. In 
section [Vj we present a study of high- Reynolds experimental data and a theoretical analysis 
of the e-entropy in turbulence. Some conclusions and remarks follow in section [VI]. Details 
on the stochastic model of a turbulent field are discussed in the Appendices. 



II. THE 6-ENTROPY 

Assume a given time-continuous record of one observable, x(t) G H, over a total time T 
long enough to ensure a good statistics. For the sake of simplicity, we start considering x as 
an observable of a Id system. 

The estimate of the entropy of the time record x(t) requires the construction of a symbolic 
dynamics With this purpose, one considers, as a first step, a grid on the time axis, by 

introducing a small time-interval, r, so as to obtain a sequence {xi = x(tj), i = 1, . . . , N}, 
with N = [T/t] ([■] denotes the integer part). As a second operation, one performs a coarse- 
graining of the phase space, with a grid of mesh size e, and defines a set of symbols, {S} 
(the letters of the alphabet), that biunivocally correspond to the so formed cells. Then, one 
has to consider the different words of length n, out of the complete sequence of symbols: 

^T( e > r ) = (Sk, Sk+i, • • • , Sk+n-l) , 

where Sj labels the cell containing xj. See Fig. 1 where the above codification is sketched. 
From the probability distribution P(W n (e,r)), estimated from the words frequencies, one 
calculates the block entropies H n (e,r): 
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H n (e,r) = - P(W n (e,r))lnP(W n (e,r)), (1) 

{W n {t,r)} 

where {W n (e, r)} indicates the set of all possible words of length n. The (e, r)-entropy per 
unit time, h(e,r), is finally defined as: 

h n {e, t) = ~[H n+1 (e, t) - H n (e, r)] , (2) 

T 

h(e,r) = lim h n (e,r) = - lim -H n (e,r) . (3) 

n^oo j- n—>oo 7% 

For practical reasons the dependence on the details of the partition is ignored, while the 
rigorous definition is given in terms of the infimum over all possible partitions with elements 
of diameter smaller than e [0,0. Note that the above defined (e, r)-entropy is nothing but 
the Shannon-entropy of the sequence of symbols {Si}. In the case of the time-continuous 
evolutions, whose realizations are continuous functions of time, the r dependence of h(e, r) 
does not exist |5|Jl5[|. When this happens, one has a finite e-entropy per unit time, h(e). For 



genuine time-discrete systems, one can simply put h(e) = h(e, r = 1). In all these cases 

h KS = lim/i(e) , (4) 

e— >0 

The determination of hxs involves the study of the limits n —>■ oo and e —>■ which are 
in principle independent, but in all practical cases one has to find an optimal choice of the 
parameters such that the estimated entropy is close to the exact value |]||. 
For a genuine chaotic system, one has < h^s < °°> i- e - the rate of information creation 
is finite. On the other hand, for a continuous random process h^s — 00 • Therefore, in 
order to distinguish between a purely deterministic system and a stochastic system it is 
necessary to perform the limit e — > 0. Unfortunately, from a physical or numerical point of 
view this is extremely difficult. Nevertheless, by looking at the behaviour of the e-entropy 
of the signal at varying e one can have some qualitative and quantitative insights on the 
chaotic or stochastic nature of the underlying process 0. Moreover, for some stochastic 
processes one can explicitly give an estimate of the entropy scaling behaviour of e-entropy 
0. For instance, in the case of a stationary Gaussian process with spectrum S(u) oc u~ 2 , 



Kolmogorov |L3| has rigorously derived 



h(e) ~ i , (5) 



for small e. However, as we show in the following simple but non-trivial example there are 
many practical difficulties in the computation of h(e) fljl4]|. Let us consider the chaotic 
map: 

x t+ i = x t + p sin 2Tix t , (6) 
which for p > 0.7326 . . . produces a large scale a diffusive behaviour Hl6"l , i.e.: 



((x t - XqY} ~ 2 D t for t -> oo , (7) 
where D is the diffusion coefficient. By computing the e-entropy of this system one expects 
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hie) ~ A for e < 1 hie) oc — for e > 1, (8) 

e 2 

where A is the Lyapunov exponent. In Fig. 2 we show that the numerical computation of h{e), 
using the standard codification (Fig. 1) is highly non-trivial already in this simple system. 
Indeed the behaviour @ in the diffusive region is just poorly obtained by considering the 
envelope of h n {e,r) computed for different values of r; while looking at any single (small) 
value of t (one would like to put r = 1) one obtains a rather inconclusive result. This is due 
to the fact that one has to consider very large block lengths, n, in order to obtain a good 
convergence for H n+1 (e, r) — H n (e, r) in (^|). In the diffusive regime, a dimensional argument 
shows that the characteristic time of the system at scale e is T t « e 2 /D. If we consider for 
example, e = 10 and typical values of the diffusion coefficient D ~ 10 _1 , the characteristic 
time, T e , is much larger than the elementary sampling time r — 1. 

Concluding this section, we remind that for systems living in d > 1 dimensions, the procedure 
sketched above, for the determination of h(e,r), goes unaltered, considering that the set of 
symbols {S} now identifies cells in the d-dimensional space where the state-vector x(i) 
evolves. 

III. HOW TO COMPUTE THE 6-ENTROPY WITH EXIT TIMES 

The approach we propose to calculate h(e) differs from the usual one in the procedure to 
construct the coding sequence of the signal at a given level of accuracy |T^]. This is an 
important point because the quality of the coding affects largely the result of the e-entropy 
computation. An efficient procedure reduces redundancy and improves the quality of the 
results. The problem to encode signals efficiently is quite old and widely discussed in the 
literature P,|T7[]. The most efficient compression or codification of a symbolic sequence is 
linked to its Shannon entropy. The Shannon's compression theorem [f|] states: given an 
alphabet with m symbols, and a sequence of these symbols, {Si, i = 1, . . . , N}, with entropy 
h, it is not possible to construct another sequence {S'^i = 1,...,N'} - using the same 
alphabet and containing the same infomation - whose length N' is smaller than (h/ \nm)N. 
That is to say: h/hxm is the maximum allowed compression rate. As a consequence, if 
one is able to map a sequence {si,i = 1,...,N S } of m symbols, into another sequence 
{<Ti, i — 1, . . . , N,j}, with the same symbols, the ratio (N a /N s ) him gives an upper bound for 
the entropy of {sj}. More generally, if {a{\ is a codification of {s{\ without information loss, 
then the two sequences must have equal total entropy: N s h(s) = N a h(a). 
Now we introduce the coding of the signal by the exit-time, t(e), that is the time for the 
signal to undergo a fluctuation of size e. To do so, we define an alternating grid of cell size 
e in the following way: we consider the original continuous-time record x(t) and a reference 
starting time t = t . The first exit-time, t\, is then defined as the first time necessary to 
have an absolute variation equal to e/2 in x(t), i.e., \x(t + tx) — x(t )\ > e/2. This is the 
time the signal takes to exit the actual cell of size e. Then we restart from t\ to look for 
the next exit-time t 2 , i.e., the first time such that \x(t +ti + t 2 ) — x(t +ti)\ > e/2 and so 
on, to obtain a sequence of exit-times: {U(e)}. To distinguish the direction of the exit (up 
or down out of a cell), we introduce the label fcj = ±1, depending on whether the signal is 
exiting above or below. For clarifying the procedure see Fig. 3, where we sketch the coding 
method for the signal shown in Fig. 1. 
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From Fig. 3 one recognises the alternating structure of the grid: the starting point to find 
t i+ i lies in the middle of the cell x{tj) ± e/2, whereas it lies on the border of the cell 
x(ti_i) ± e/2. In this way one avoids the fast exit out of a cell due to small fluctuations 
(compare Figs. 1 and 3). At the end of this construction, the trajectory is coded without 
ambiguity, with the required accuracy, by the sequence {(U, ki), i = 1, . . . , M}, where M 
is the total number of exit-time events observed during the total time T. A continuous 
signal, evolving in a continuous time, is now coded in two sequences - a discrete-valued 
one {ki} and a continuous- valued one {tj}. Performing a coarse-graining of the possible 
values assumed by t(e) by the resolution time r n we accomplished the goal of obtaining a 
symbolic sequence. After that, one proceeds as usual, studying the "exit-time words" of 
various lengths n. These are the subsequences of couples of symbols 

fi f( e > T r) = {{Vh h), (Vi+1, k+l), • • • , (Vi+n-l, k+n-l)) , (9) 

where rjj labels the cell (of width r r ) containing the exit-time tj. From the probabilities of 
these words one calculates the block entropies at the given time resolution, H^(e,T r ), and 
then the exit-time (e, r r )-entropies: 

h Q {e, Tr ) = hm H% +1 (e, r r ) - H%, r r ) . (10) 

The limit of infinite time-resolution gives us the e-entropy per exit, i.e.: 

h?(e) = lim h u (e,T r ) . (11) 

This result may be obtained also by arguing as follows. There is a one-to-one correspondence 
between the (exit-time)-histories and the (e, r)-histories (in the limit r — > 0) originating from 



a given e-cell. The Shannon-McMillan theorem [|l8j assures that the number of the typical 
(e, r)-histories of length N, Af(e,N), is such that: In jV(e, N) ~ h(e)Nr = h(e)T. For 
the number of typical (exit-time)-histories of length M, A4(e,M), we have: ln.M(e, M) ~ 
h (e)M. If we consider T = M(t(e)) we must obtain the same number of (very long) 
histories. Therefore, from the relation M = T/(t(e)), where (t(e)) = 1/M Y^fLiti, we obtain 
finally for the e-entropy per unit time: 

M/^e) _ /^e) 
[e) T ~ (t(e)> • {LZ) 

Note that a relation similar to (|12|), without the dependence on e, has been previously 



proposed, in the particular case of the stochastic resonance flT9|| . In such a case, where 
x(t) effectively takes only the two values ±1 and the transition can be assumed to be 
instantaneous, the meaning of the equation is rather transparent. 

At this point we have to remind that in almost all practical situations there exists a minimum 
time interval, r s , a signal can be sampled with. Since there exists this minimum resolution 
time, we can at best estimate h (e) by means of h n (e) = h n (e, t s ), instead of performing the 
limit ([EL]); so that we may put: 

h n (e r ) 

«,) - , (13) 
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for small enough r r . In most of the cases, the leading e-contribution to h(e) in ([13]) is given 
by the mean exit-time (t(e)) and not by h n (e,r r ). Anyhow, the computation of h n (e,r r ) is 
compulsory in order to recover, e.g., a zero entropy for regular (e.g. periodic) signals. 
Now we discuss how one can estimate the e-entropy in practice. In particular we introduce 
upper and lower bounds for h(e) which are very easy to compute in the exit time scheme 
l4| . We use the following notation: for given e and r r , h n (e,r r ) = h n ({r]i, ki}), and we 



indicate with h n ({ki}) and h n ({r]i}) respectively the Shannon entropy of the sequence {ki} 
and {rji}. By applying standard results of information theory 0] one obtains: 

a) /^({^})</^({r^}), 

since the mean uncertainty on the composed event {rji, ki} cannot be smaller than that 
of a partial one {ki} (or {rji}); 

b) ^({^k,}) < h n ({ Vt }) + h^({k t }), 

since the uncertainty is maximal if {ki} and {rji} are independent (correlations can 
only decrease the uncertainty). 

Moreover, we observe that, for a given finite resolution r r , the associated sequence {rji} 
satisfies the bound: 

h a {{m}) < H?({ Vi }) , 

In the above relation H^({rji}) is the one-symbol entropy of {rji}, (i.e. the entropy of the 
probability distribution of the exit-times measured on the scale r r ) which can be written as 



#i(M) = c(e)+ln 

where c(e) = — / p(z) hnp(z)dz, and p(z) is the probability distribution function of the 
rescaled exit-time z(e) = t(e)/(t(e)). Finally, using the previous relations, one obtains the 
following bounds for the e-entropy: 

(t(e)) (t(e)) ■ U4j 

Note that such bounds are relatively easy to compute and give a good estimate of h(e). 
The Equations ( |I2| - |T4|) allow for a remarkable improvement of the computational efficiency. 



Especially as far as the scaling behaviour of hie) is concerned, one can see that the leading 
contribution is given by (t(e)), and that h n (e,T r ) introduces, at worst, a sub-leading loga- 
rithmic contribution h n (e,r r ) ~ ln((t(e))/r r ) (see eq. (|14D). This fact is evident in the case 
of Brownian motion. In this case one has (t(e)) oc e 2 /D, and 

(i) c(e) is 0(1) and independent of e (since the Brownian motion is a self-affine process); 

(ii) hP({ki}) < In 2, is small compared with ln((t(e))/r r ). So that, neglecting the logarith- 
mic corrections, h(e) ~ l/(t(e)) oc Dt~ 2 . 

In Fig. 4 we show the numerical evaluation of the bounds ( |T4| ) for the diffusive map (^|). 
Fig. 4 has to be compared with Fig. 2, where the usual approach has been used. While 
in Fig. 2 the expected e-entropy scaling is just poorly recovered as an envelope over many 
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different r, within the exit time method the predicted behaviour is easily recovered in all 
the range of e > 1 with a remarkable improvement in the quality of the result. 
We underline that the reason for which the exit time approach is more efficient than the 
usual one is a posteriori intuitive. Indeed, at fixed e, (t(e)) automatically gives the typical 
time at that scale, and, as a consequence, it is not necessary to reach very large block sizes 
- at least if e is not too small. Especially for large e, we found that small word lengths 
are enough to estimate the e-entropy accurately. Of course, for small e (i.e. the plateau of 
Fig. 4) one has to use larger block sizes: here the exit time is 0(1) and one falls back to the 
problems of the standard method. 

For small e in deterministic system one has to distinguish two situations. 

(a) e — > for discrete-time systems. 

In this limit the exit-time approach coincides with the usual one. The exit-times always 
coincide with the minimum sampling time, i.e. {t(e — > 0)) ~ 1 and we have to consider 
the possibility to have jumps over more than one cell, i.e., the ki symbols may take 
values ±1, ±2, . . .. 

(b) e — > for continuous-time systems. 

At very small e, due to the deterministic character of the system, one has (t(e)) ~ e, 
and therefore one finds words composed with highly correlated symbols. So one has 
to treat very large blocks in computing the entropy pl|j . 

However, as far as high dimensional systems are concerned, for some aspects, the points (a) 
and (b) are not of practical interest. In these systems the analysis of the e — ^ limit is usually 
unattainable for several reasons and, moreover, in many cases one is more interested 
in the large e scale behaviour. We believe that in these cases the approach presented here, 
is practically unavoidable. 

We conclude this section with two further remarks. First, up to now we considered a 
scalar signal as the output of a one-dimensional system. This fact only entered in the two- 
valuedness of the variable. If we are given a vectorial signal x(t), describing the evolution 
of a d-dimensional system, we have only to admit 2d values for the direct ion-of-exit variable 
k. If the dynamics is discrete one has also to consider the possibility of jumps over more 
than one cell (see previous discussion). 

Second, one can wonder about the dependence of h(e) on the used observable. Rigorous 
results insure that the Kolmogorov- Sinai entropy, i.e. the limit e — > of h(e) is an intrinsic 
quantity of the considered system, its value does not change under a smooth change of 
variables. In the case of (e, r)-entropy, in principle there could be dependencies on the 
chosen function. However, one can see that at least the scaling properties should not strongly 
depend on the choice of the observable. If A(x) is a smooth function of x, such that the 
following property holds: 



with Ci and C2 finite constants, then there exist two constants a\ and c*2 such that 




(15) 




(16) 
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where /i^(e, r) and h x (e, r) are the (e, r)-entropies computed using the observable A and x, 
respectively. This result implies that if h(e, r) shows a power-law behaviour as a function of 
e, h(e, t) ~ e~@, the same behaviour, with the same exponent (3, must be seen when using 
another, smooth, observable in the determination of the (e, r)-entropy. 



IV. APPLICATION OF THE 6-ENTROPY TO DETERMINISTIC AND 

STOCHASTIC PROCESSES 



A. An intermittent deterministic mapping 



We discuss the application of exit-time approach to the computation of e-entropy in strongly 
intermittent low-dimensional systems. 

In presence of intermittency, the dynamics is characterised by very long, almost quiescent 
(laminar) intervals separating short intervals of very intense (bursting) activity (see Fig. 5). 
Already at a qualitative level, one realises that coding the trajectory shown in Fig. 5 at 
fixed sampling times (Section ||) is not very efficient compared with the exit times method, 
where the information on the very long quiescent periods is typically stored using only one 
symbol. 

To be more quantitative, let us consider the following one dimensional intermittent map 
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x t+i — ( x t + axf) mod 1 , (17) 

with z > 1 and a > 0. The invariant density is characterised by a power law singularity near 
x = 0, which is a marginally stable fixed point, i.e. p(x) oc x l ~ z . For z > 2, the density is 
not normalisable, and an interesting dynamical regime, the so-called sporadic chaos, appears 
22fl . Namely, for z > 2 the separation between two close trajectories behaves as: 



\Sx n \ ~ 5x exp [cn UQ {\nn) V1 } , (18) 

with < uq < 1 or u = 1 and V\ < 0. In the sporadic chaos regime, nearby trajectories 
diverge with a stretched exponential, even if the Lyapunov exponent is zero. For z < 2 the 
system follows the usual chaotic motion with v = 1 and V\ = 0. 

Sporadic chaos is intermediate between chaotic motion and regular one. This can be under- 
stood by computing the Kolmogorov-Chaitin-Solomonoff complexity p2], or, as we show in 
the following, by studying the mean exit time. 

By neglecting the contribution of h Q (e), and considering only the mean exit time, we can 
estimate the total entropy, if at, of a trajectory of length iV as 

N 

H N oc for large N , (19) 

where ([••■])jv indicates that the mean exit time is computed on a sequence of length N. 
Due to the power law singularity at x — 0, (i(e))jv depends on N. In equation ([19|) , we 
have dropped from H N the dependence on e, which is expected to be weak. Indeed, due 
to singularity near the origin, one has that the exit times at scale e are dominated by the 
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first exit from a region of size e around the origin. So that, (t(e))jv approximately gives the 
duration of the laminar period (this is exact for e large enough). 

In Fig. 6, the behaviour of (t(e))jv is shown as a function of N and z for two different choices 
of e. For large enough N the behaviour is almost independent of e, and for z > 2 one has 

z — 2 

(t(e))jv oc iV a , where a = - — - . (20) 

The value of a is obtained by the following argument: the power law singularity leads to 
Xt ~ most of the time, and moreover, near the origin the map fll8|) can be approximated by 



the differential equation dx/dt = ax z PHI . Therefore, denoting with x the initial condition, 



one solves the differential equation obtaining 

(xo + e) 1 " 2 -Xq 1 " 2 = a(l- z)t(e). 

Now, due to the singularity, xo is typically much smaller than xo+e, and hence we can neglect 
the term (xo + e) 1-2 , so that the exit time is t(e) oc Xq~ 2 . By the probability density of 
xo, p(xo) oc Xq~ 2 , one obtains the probability distribution of the exit times p(t) ~ tVC 1 -*)-^ 
the factor t _1 takes into account the non-uniform sampling of the exit time statistics (see 
discussion after equation (p5|). Finally the average exit time on a trajectory of length N, 
which is given by 

r N z-2 
(t{e)) N ~ I tp{t)dt~N—. (21) 

The total entropy is finally given by 



o 



Hn ~ — — ~ , 
AT— 

note that this is exactly the same iV-dependence found with the computation of the algo- 
rithmic complexity f22]| . Let us underline that the entropy per unit time goes to zero very 
slowly, because of the sporadicity 

Hat 1 



IN 



N (t(e)) N ' 

Let us note that we arrive at this results without any partitions of the phase space of the 
system. 



B. AfRne and multi-affine stochastic processes 

Self-affine and multi-affine processes are fully characterised by the scaling laws of the mo- 
ments of signal increments [11,23,24|, 5tx = x(to) — x(io + t) : 



((\S t x(t )\«)) ~ t<® , (22) 

where ((q) is a linear function of q, ((q) = £ q, for a self-affine signal (£ is the Holder 
exponent characterising the process) and a non-linear function of q for a multi-affine signal. 
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The average ((•)) is defined as the average over the process distribution P(to, 5 t x(to)), which 
gives the probability to have a fluctuation, 5 t x(to), at the instant to- 111 the case of a 
stationary process, as it will be always assumed here, the probability distribution is time 
invariant and the average ((•)) is computed by invoking an ergodic hypothesis, as a time- 
average. 

Sometimes, with an abuse of language, a multi-affine process is also called a multi-fractal 
process. While a self-affine process has a global scaling-invariant probability distribution 
function, a multi-affine process can be constructed by requiring a local (in time) scaling 
invariant fluctuations \TT\. In a nutshell, one assumes a spectrum of different local scaling 



exponents £: 5 t x(t ) ~ ££(*o) with the probability -Pf(£) ~ to observe a given Holder 

exponent £ at time increment t. The function -D(£) can be interpreted as the fractal dimen- 
sion of the set where the Holder exponent £ is observed |[23|| . The scaling exponents ((q) are 
related to D(£) by a Legendre transform. Indeed, one may define the average process as an 
average over all possible singularities, £, weighted by the probability to observe them: 

«(M 9 »~ Jd^n 1 -^ , 

which in the limit of small t by a saddle point estimation becomes: 

(((5 t x) q )) ~t c(<?) with CO?) = min(g£ + 1 - £>(£)) • (23) 

Eq. ( P3"D can be generalised to £(g) = min^(g£+(i— -D(£)) if the considered signal is embedded 
in a d-dimensional space. 

Let us notice that in this language, the already discussed Brownian motion corresponds to 
a self-affine signal with only one possible exponent £ = 1/2 with .0(1/2) = 1. In Appendix 
A one finds how to construct arbitrary self-affine and multi-affine stochastic processes. 
Let us now investigate the e-entropy properties of these two important classes of stochastic 
signals by using the exit-time approach. We will proceed by discussing the general case of 
multi-affine processes, noting that the self-affine one is a particular case of them correspond- 
ing to have only one exponent in the spectrum. 

The exit-time probability distribution function can be guessed by "inverting" the multifractal 



probability distribution functions p5| . We expect that the following dimensional inversion 
should be correct (at least as far as leading scaling properties are concerned). We argue 
that the probability to observe an exit of the signal through a barrier of height 5x in a time 
t(Sx) is given by Ps x (t(5x)) ~ (Sx)^ ^"^ where the height of the barrier and the exit- 
time are related by the inversion of the previously introduced multi-affine scaling relation 
t(Sx) ~ (Sx) 1 ^. In this framework we may write down the "multifractal" estimate |25| of 
the exit-time moments, also called inverse structure functions 



Z q (6x) = ((t g (6x))) ~ / d£(fe) £±i T £m ~ (5x) xM , (24) 



where x{q) is obtained with a saddle point estimate in the limit of small Sx: 

qiii 



. ( q + l-D(Z) \ 
X[q) = mm . (25) 
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The averaging by counting the number of exit-time events M (as we did in the previous 
sections) and the averaging with the uniform "multi-fractal" distribution are connected by 



the following relation : 



M 



((«= i> 



q 



i mitj (t(sx)) 

where the term U/Y^jLitj takes into account the non-uniformity of the exit-time statistics. 
From the previous relation evaluated for q = —1 we can easily deduce the estimate for the 
mean exit-time scaling law: 

(t(8x)) = ((r^Sx)))- 1 ~ (5xy x ^ (26) 

and therefore, as in the previous sections, we may estimate the leading contribution to the 
e-entropy of a multi-affine signal: 

h(5x) ~ {5x) x{ - 1) . (27) 

Let us notice that in the simpler case of a self-affine signal with Holder exponent £, this 
is nothing but the dimensional estimate h(8x) ~ (5x)~ 1 ^ which is rigorous for Gaussian 



processes [ l3| . In this case the above argument is also in agreement with the bounds fll4|): 
indeed for an affine signal the function c(e) entering in flUD does not depend on e (we note 
here that Sx plays the same role of e). 

In Fig. 7a-b we show the numerical estimate of the bounds ( |H] ) on the e-entropy in two 
different self-affine signals with Holder exponents £ = 1/3 and £ = 1/4 respectively (for 
details on the processes generation see Appendix A). The agreement with the expected 
result is very good. Let us notice that with the usual approach to the calculation of the 
e-entropy for these simple signals the detection of the scaling behaviour is not so easy (see 
Figures 15,16 and 17 of 0). 

In Fig. 8 we show the numerically computed lower and upper bounds for the e-entropy of a 
multi-affine signal by using the mean exit-time estimate. The multi-affine signal here studied 
is characterised by having ((q) as the scaling exponent measured in turbulence (see next 
section). In particular, this means that £(3) = 1, and using Eqs. ( |23| ) and fl2"5|) x(—l) = —3 
independently on the shape of -D(£). This is the e-entropies counterpart of the Kolmogorov 
4/5 law [[TIJ. 



The agreement with the multifractal prediction (the straight lines in Fig. 8) is impressive. 
To our knowledge this is the first direct estimate of e-entropy in multi-affine signals. We 
stress that the non trivial aspect of such an estimate is contained in the derivation of the 
inverse multifractal formulas (E3)-(|25D. 



V. 6-ENTROPY AND EXIT TIMES IN TURBULENCE 

A turbulent flow is characterised by the presence of highly non-trivial chaotic fluctuations 
in space and time [TI| . The question we want to address here is to understand which kind of 



information can be captured by studying the e-entropy of this important high dimensional 
dynamical system. The main physical mechanism is the energy transfer from large scales, 
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Lq, i.e. scales where forcing is active, down to the dissipation scale, 77, where kinetic energy is 
converted into heat fill, 24] . The ratio between these two scales increases with the Reynolds 



number. Fully developed turbulence corresponds to the limit of very high Reynolds numbers. 
In this limit, a turbulent velocity field develops scaling laws in the range of scale intermediate 
between Lq and 77, the so-called inertial range. Kolmogorov (1941) theory assumes a perfect 
self-similar behaviour for the velocity field in the inertial range. In other words, the velocity 
field was thought to be a continuous self-affine field with Holder exponent £ = 1/3 as a 
function of its spatial coordinates: 

\v(x + R,t) -v(x,t)\ ~ R 1/3 , 

(hereafter, for simplicity, we neglect the vectorial notation). In terms of an averaged ob- 
servable, this implies that the structure functions, i.e. the moments of simultaneous velocity 
differences at distance R, have a pure power-law dependency for r\ <C R <C L : 

S P (R) = ((\v(x + R,t)-v(x,t)\ p )) (28) 

with ((p) = p/3. Experiments and numerical simulations have indeed shown that there are 
small (but important) corrections to the Kolmogorov (1941) prediction. This problem goes 
under the name of intermittency, the origin of which is still one of the main open problem 
in the theory of Navier-Stokes equations p4].|24|.[27|] . In the language of the previous section, 



an intermittent field is a multi-affine process. 

As far as the time-dependency of a turbulent velocity field is concerned, one can distinguish 
between two different time measurements. First, the standard one (actually used in most of 
the experimental investigation), consists in measuring the time evolution by a probe fixed in 
some spatial location, say x p , in the flow. The time evolution obtained in this way is strongly 
affected by the spatial correlations induced by the large scales sweeping. As a result, one 
can apply the so-called frozen-turbulent hypothesis (Taylor hypothesis) [27], which connects 



a time-measurement with a spatial measurement by the following relation: 

v(x p , t + t) - v(x p , t ) ~ v(x p - R, t ) - v(x p , t ) 

where R = tUo, where Uq is the mean large scale sweeping velocity characteristic of the 
experiment. 

As a result of the Taylor-hypothesis, one has that time-measurements also show power- 
law behaviour with the same characteristic exponents of the spatial measurements, namely, 
within the Kolmogorov theory: 

((\v(x p ,to + t)-v(x p ,t )\v))~ t ^ . 
A second interesting possibility to perform time measurements consists in the so-called La- 



grangian measurements p8fl . In this case, one has to follow the trajectory of a single fluid 
particle and measuring the time properties locally in the co-moving reference frame. The 
main characteristics of this method is that the sweeping is removed and so one can probe in 
details the "proper" time-fluctuations induced by the non-linear terms of the Navier-Stokes 



equations (for recent theoretical and numerical investigations of similar issues see [28] |3 



The phenomenological understanding of all these spatial and temporal properties are well 
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summarised by the Richardson- cascade. The cascade picture describes a turbulent flow in 
terms of a superposition of fluctuations (eddies) hierarchically organised on a set of scales 
ranging from the largest one, L , to the smallest one, r], say £ n = 2~ n L , with n = 0, . . . , N max 
and N max = \og 2 (L /r]). Each scale has its own typical evolution time, r n , given in terms of 
the velocity difference at that scale, 5 n v = v (x + £ n ) — v(x), by the dimensional estimate: 
i~n = £ n /S n v ~ (^n) 2//3 - The most relevant dynamical interactions are supposed to happen 
only between eddies of similar size, while each eddy is also subject to the spatial sweeping 
from eddies at larger scales. The energy is transferred down-scale from the largest-eddy 
(the mother) to its daughters and from the daughters to their grand-daughters and so on in 
a multi-step process similar, quantitatively and qualitatively to a stochastic multiplicative 
process pl|,|32 |. 



As a result of the previous picture, one can mimic a turbulent flow with a stochastic process 
hierarchically organised in space, and with suitable time-dependence able to reproduce both 
the overall sweeping and the eddy-turn-over times hierarchy [^,0. In the Appendices A 
and B we briefly remind a possible choice for these stochastic process. 



A. Experimental data analysis 

We present now the computation of the e-entropy for two sets of high Reynolds number 
experimental data, obtained from an experiment in Lyon (at Re\ = 400) and from another 
experiment in Modane (at Re\ = 2000). The measurement in Lyon has been taken in a wind 
tunnel with a working section of 3.0 m and a cross section of (0.5 m)x(0.5 m). Turbulence 
was generated by a cylinder placed inside the wind tunnel, its diameter was 0.1 m. The 
hot wire was placed 2.0 m behind the cylinder. The separation between both probes was 
approximately 1 mm |40 |. The measurement in Modane has been taken in a wind tunnel 



where the integral scale was L ~ 20 m and the dissipative scale was rdiss = 0.3 mm. 
Let us first make an important remark. Whenever one wants to apply the multifractal 
formalism to turbulence there exist some analytical and phenomenological constraints on the 
shape of the function D(£) entering in the multifractal description. In particular, the most 
important constraint is the exact result ((3) = 1. This, in turn, implies that independently 
of the possible multifractal spectrum of the turbulent field one has x(~ 1) = ~~ 3. So that as 
stated in the previous section, one obtains: 

h(e) ~ e* (_1) = e" 3 , (29) 



this is the e-entropy equivalent of the ((3) = 1 result, i.e. of the 4/5 law of turbulence [11 
(see equations ( ^6|) and (^3)). This means that there are not intermittent corrections to the 
e-entropy. We have tested this prediction (here for the first time presented), which has been 
already confirmed in the analysis of the stochastic multi-affine signal in section IV-B, in two 
different experimental data sets. 

In Fig. 9 we show the e-entropy computed for two different sets of experimental data. As one 
can see, the theoretical prediction h(e) ~ e~ 3 is well reproduced only for large e values, while 
for intermediate values the entropy shows a continuous bending without any clear scaling 
behaviour, only when e reaches values corresponding to dissipative velocity fluctuations we 
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have the dissipative scaling (t(e)) ~ e. 

The strong intermediate regime between the dissipative and the inertial scaling behaviours 
is not a simple out-of-control finite Reynolds-effect. In fact, within the multifractal model of 
turbulence, one can understand the large crossover between the two power laws in terms of 
the so-called Intermediate-Dissipative- Range (IDR). The existence of an IDR was originally 



predicted in |35j and furtherly analysed in |25|j36|j37|1 . 

The IDR brings the signature of the mechanism stopping the turbulent energy cascade, 
i.e. how viscous mechanism are effective in dissipating turbulent energy. In particular, it 
was shown that the IDR can be fully described within the multifractal description once 
one allows the possibility to have different viscous cut-off depending on the local degree of 
velocity singularity, i.e. depending on the local realization of the £ scaling exponent. The 
main idea consists in using again the multifractal superposition ( p4| ) but considering that for 
velocity fluctuations at the edge between the inertial and the viscous range not all possible 
scaling exponents contribute to the average P5]J25| . It turns out that in the case of exit- 
time moments, the extension of the IDR is much more important then what was previously 
measured for the velocity structure functions (p8|). Therefore, the strong finite-range effects 
showed by the experimental data analysis of Fig. 9 can be qualitatively and quantitatively 
understood as an effect of the IDR 



Let us conclude this section by comparing our results with a previous study of the e-entropy 



in turbulence [12). There it was argued the following scaling behaviour: 

h(e) ~ 6" 2 , (30) 



which differs from our prediction. The behaviour ( |3~0"D has been obtained assuming that h(e) 
at scale e is proportional to the inverse of the typical eddy turnover time at that scale. We 
remind that here e represents a velocity fluctuation Sv. Since the typical eddy turnover time 
for velocity fluctuations of order 5v ~ e is r(e) ~ e 2 , the Eq. fl3U| ) follows. Recalling the 
discussion of section V-A about the two possible way of measuring a turbulent time signal it 
is clear that the scaling (|30|) holds only in a Lagrangian reference frame (see also ||). This 
explains the difference of our prediction and (|30|) . 



B. An e-entropy analysis of the Taylor hypothesis in fully developed turbulence 

By studying the e-entropy for the velocity field of turbulent flows in 3 + 1 dimension, h st (e) 
(st indicates space and time), we argue that the usually accepted Taylor hypothesis implies 
a spatial correlation which can be quantitatively characterised by an "entropy" dimension 
P = 8/3. In this section, for the sake of simplicity, we neglect intermittency, i.e. we assume 
a pure self-affine field with Holder exponent £ = 1/3. 

We discuss now how to construct a multi-affine field with the proper spatial and temporal 
scaling. The idea consists in defining the signal as a dyadic three-dimensional superposition 
of wavelet-like functions y?((x — x nt k(t)) / £ n ) whose centres move according to a swept dy- 
namics. The coefficients of the decomposition a^kit) are stochastic functions chosen with 
suitable self-affine scaling properties both in time and in space. In particular, the exact 
definition for a field with spatial Holder exponent £ in d dimensions is (see Appendix A and 
B for details): 
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n=l k=l \ ln ) 

where x nj fc is the centre of the k th wavelets at the level n (for each dimension we consider 
one branching (i.e. two variables) for passing to the n + 1 level, see Fig. 10). According 
to the Richardson- Kolmogorov cascade picture, one assumes that sweeping is present, i.e., 
Xri+i,fc = x n) fc/ + r n+ i t k where (n, k') labels the "mother" of the (n + 1, /c)-eddy and r^+i^ is 
a stochastic vector which depends on r n ^ and evolves with characteristic time r n oc (in) 1 
If the coefficients {a n ^} and {v n ,k} have characteristic time r n ~ (4i) 1- ^ and {a n ^k\ ~ 
it is possible to show (see Appendix A and B for details) that the field ( pi] ) has the properties 

Kx + R,t ) -v(x,t„)| ~ |R| ? , (32) 
|v(x,to + t) -v(x,to)| ; (33) 

in addition the proper Lagrangian sweeping is satisfied. Now we are ready for the e-entropy 
analysis of the field fl3"T|). If one wants to look at the field v with a resolution e, one has to 
take n up to iV given by: 



V -N 



) ? ~ e , (34) 



in this way we are sure to consider velocity fluctuations of order e. Then the number of 
terms contributing to (|3~ID is 

#(e) ~ (2X ~ e"^ . (35) 

By using a result of Shannon ||] one estimates the e-entropy of the process a ntk (t) (and also 
of r nJ ) as: 

h n (e)^-\ og (-) , (36) 



where the above relation is rigorous if the processes a n ,k(t) are Gaussian and with a power 
spectrum different form zero on a band of frequency ~ l/r n . The terms which give the main 

contribution are those with n ~ N with ~ (^v) 1 ^ ~ e^~\ Collecting the above results, 
one finds 



h«(e) ~ m „ e -^P . (37) 

For the physical case d — 3, £ = 1/3, one obtains 

/^(e) ~ e^ 11 . (38) 

The above result, has already been obtained in |7| with a different consideration. By denoting 
with Vk the typical velocity at the Kolmogorov scale rj, one has that Eq. flSjj) holds in the 
inertial range, i.e., e > i> & ~ i?e~ 1//4 , while for e < u^, /i s *(e) = constant ~ i?e 11//4 . Let us 
now discuss the physical implications of (|37|). 
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Consider an alternative way to compute the e-entropy of the field v (x, t): divide the d- volume 
in boxes of edge length 1(e) ~ e 1 ^ and look at the signals v(x. a ,t), where the x Q are the 
centres of the boxes. In each x a , we have a time record whose e-entropy is 

hP*(e) ~ e~ 1/? (39) 

because of the scaling (|33|) . In (|3~9"D we use the symbol h^ a ' to denote the entropy of the 
temporal evolution of the velocity field measured in x a . Therefore, h st (e) will be obtained 
summing up all the "independent" contributions (|39|), i.e. 



h st (e) ~ A^(e)/i (a) (e) ~ A/"(e)e~ 1/f , (40) 

where Af(e) is the number of the independent cells. It is easy to understand that the simplest 
assumption A/"(e) ~ l(e) d ~ e d ^ gives a wrong result, indeed one obtains 

h st {e) ~ , (41) 

which is not in agreement with ([37]). In order to obtain the correct result (|38|) it is necessary 
to assume 

Af(e) ~ l{e) v , (42) 

with X> = d — £. In other words, one has to consider that the sweeping implies a nontrivial 
spatial correlation, quantitatively measured by the exponent T>, which can be considered as 
a sort of "entropy" dimension. Incidentally, we note that T> has the same numerical value 
as the fractal dimensions of the iso-surfaces v = const. IK8II . From this observation, at first 



glance, one could conclude that the above result is somehow trivial since it is simply related 
to a geometrical fact. However, a closer inspection reveals that this is not true. Indeed, one 
can construct a self-affine field with spatial scaling £ and thus with the fractal dimension 
of the iso-surfaces v = const, given by d — £ for geometrical reasons, while T> — d. Such a 
process can be simply obtained by eliminating the sweeping, i.e., 

«CM) = E E a n , k (t) J^-^-) , (43) 

n=l k=l V <-n / 



where now the x n ^ are fixed and no longer time-dependent, while a n ^ ~ (^n)^ but r n ~ £ n . 

For a field described by (f43[) one has that (0) and (p3|) hold but /i s (e) ~ e « and V = d, 
while the fractal dimension of the iso-surfaces v = const, is d — £. 

We conclude by noting that it is possible to obtain (see 0) the scaling fl37|) using equa- 
tion (0), i.e. ignoring the sweeping, assuming r n ~ (C) 1- ^ an d a nj fc ~ (^n)^> this corre- 
sponds to take separately the proper temporal and spatial spectra. However, this is not 
completely satisfactory since one has not the proper scaling in one fixed point, (see eq. ( |39| ) 
the only way to obtain this is through the sweeping). 



VI. CONCLUSION 

In this paper we have discussed a method, based on the analysis of the exit-time statistics, 
for the computation of the e-entropy. The basic idea is to look at a sequence of data not 
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at fixed sampling time but only when the fluctuation in the signal is larger than some fixed 
threshold, e. This procedure allows a remarkable improvement of the possibility to compute 
(e, r)-entropy, which is well represented by the exact results ([12|) and the bounds ([Hp. 
This approach is particularly suitable in all the systems without a unique characteristic 
time. In these cases the method based on a coarse-grained dynamics on a fixed (e, r) grid 
does not work very efficiently since words of very long size are involved. 
On the basis of the coding in terms of the exit-time events we are able to give significant 
lower and upper bounds to the e-entropy. 

We have applied the method to different systems: chaotic diffusive maps, intermittent maps 
showing sporadic chaos, self-affine and multi-affine stochastic processes, and experimental 
turbulent data. 

Applying the multifractal formalism one predicts the scaling h(e) ~ e~ 3 for time measure- 
ment of velocity in one point in turbulent flows. This power law does not depend on the 
intermittent corrections and has been confirmed by the experimental data analysis results. 
Moreover we have shown the connection of the Taylor-frozen hypothesis and the e-entropy: 
the sweeping implies a nontrivial spatial correlation, quantitatively measured by an "en- 
tropy" dimension T> = 8/3. 
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VIII. APPENDIX A 

In this Appendix we recall some recently obtained results on the generation of multi-affine 
stochastic signals [^,0. The goal is to have a stochastic process whose scaling properties 
are fully under control. The first step consists in generating a 1-dimensional signal and the 
second in decorating it such as to build the most general (d+ 1) -dimensional process, w(x, t), 
with given scaling properties in time and in space. 

As for the simplest case of a 1-dimensional system there are at least two different kind of 
algorithms. One is based on a dyadic decomposition of the signal in a wavelet basis with a 
suitable assigned series of stochastic coefficients [Q. The second is based on a multiplication 
of sequential Langevin-processes with a hierarchy of different characteristic times |34] . 
The first procedure suits particularly appealing for the modelisation of spatial turbulent 
fluctuations, because of the natural identification between wavelets and eddies in the phys- 
ical space. The second one, on the other hand, looks more appropriate for mimicking the 
turbulent time evolution in a fixed point of the space, because of its sequential nature. 
Let us first summarise the main ingredient of both and then briefly explain how to merge 
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them in order to have a realistic spatial-temporal multi-affine signal. 

A non-sequential algorithm for 1-dimensional multi-affine signal in [0, 1], v(x), can be defined 
as [0: 

v(x) = ^2 E a n,kf( /"'* ) (44) 

n=l fc=l \ *n / 

where we have introduced a set of reference scales £ n = 2~ n and the function tp(x) is a 



wavelet-like function [3J|, i.e. of zero mean and rapidly decaying in both real space and 
Fourier-space. The signal v (x) is built in terms of a superposition of fluctuations, ip((x — 
x n ,k)/(-n) of characteristic width £ n and centred in different points of [0,1], x n ^ = {2k + 
l)/2 n+1 . In [|34] it has been proved that provided the coefficients a n ^ are chosen by a 
random multiplicative process, i.e. the daughter is given in terms of the mother by a random 
process, a n+ i^> = Xa n ^ with X a random number i.i.d. for any {n, k}, then the result of 
the superposition is a multi-affine function with given scaling exponents, namely: 

((\v{x + R) - v{x)\ p )) ~R^ , 

with ((p) = —p/2 — log 2 (X p ) and £n < R < 1. In this Appendix (•) indicates the average 
over the probability distribution of the multiplicative process. Besides the rigorous proof, 
the rationale for the previous result is simply that due to the hierarchical organisation of the 
fluctuations one may easily estimate that the term dominating the expression of a velocity 
fluctuation at scale R, in is given by the couple of indices {n, k} such that n ~ log2(R) 
and x ~ x nt k, i.e. v (x + R) — v(x) ~ a n ,k- The generalisation (|44|) to d-dimensional fields is 
given by: 

N 2 d ( n " 1 ) , _ . 

^( X ) = E E a n,kA . ,k ) , 
n=l k=l V *n / 

where now the coefficient a n ^ are given in terms of a d-dimensional dyadic multiplicative 
process. This class of stochastic fields has been of great help in mimicking simultaneous 
spatial fluctuations of turbulent flows. 

On the other hand, as previously said, sequential algorithms look more suitable for mimicking 
temporal fluctuations. Let us now discuss how to construct these stochastic multi-affine 
fields. With the application to time-fluctuations in mind, we will denote now the stochastic 
1-dimensional functions with u(t). The signal u(t) is obtained by a superposition of functions 
with different characteristic times, representing eddies of various sizes |j34| : 

N 

u(t) = E Mt) ■ (45) 

n=l 

The functions u n (t) are defined by the multiplicative process 

u n {t) = g n {t)xi(t)x 2 (t) . . . x n {t) , (46) 

where the g n (t) are independent stationary random processes, whose correlation times are 
supposed to be r n = (£ n ) a , where a = 1 — £ (i.e. r n are the eddy-turn-over time at scale 
£ n ) in the quasi-Lagrangian reference frame |28| and a = 1 if one considers u(t) as the time 
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signal in a given point, and (g%) = {t n ) 2 ^, where £ is the Holder exponent. For a signal 
mimicking a turbulent flow, ignoring intermittency, we would have £ = 1/3. Scaling will 
appear for all time delays larger than the UV cutoff r^r and smaller than the IR cutoff T\. 
The Xj(t) are independent, positive defined, identical distributed random processes whose 
time correlation decays with the characteristic time Tj. The probability distribution of Xj 
determines the intermittency of the process. 

The origin of ( pffi ) is fairly clear in the context of fully developed turbulence. Indeed we can 
identify u n with the velocity difference at scale i n and Xj with (ej/ej^i) 1 ^ 3 , where Sj is the 
energy dissipation at scale tj. 

The following arguments show, that the process defined according to (pE5|r46| ) is multi-affme: 



Because of the fast decrease of the correlation times Tj = (tj) a , the characteristic time of 
u n (t) is of the order of the shortest one, i.e., r n = (£ n ) a . Therefore, the leading contribution 
to the structure function S q (r) = ((\u(t+r) —u(t)\ q )) with r ~ r n stems from the n-th term in 
([ISP- This can be understood nothing that in the sum u(t+r)—u(t) = Y,k=i[ u k(t + T )— u k(t)} 
the terms with k < n are negligible because U)~(t + r) ~ Uk(t) and the terms with k > n are 
sub-leading. Thus one has: 

S q (r n ) ~ (\u n \ q ) ~ (\g n \ q )(xT ~ Tn« « (47) 
and therefore for the scaling exponents: 

C, = ^ - lQg2(xg) ■ (48) 
a a 

The limit of an affine function can be obtained when all the Xj are equal to 1. A proper 



proof of these result can be found in [[34 



Let us notice at this stage that the previous "temporal" signal for a = 1 — £ is a good 
candidate for a velocity measurements in a Lagrangian, co-moving, reference frame (see 
body of the article). Indeed, in such a reference frame the temporal decorrelation properties 
at scale l n are given by the eddy-turn-over times r n = {t n ) l ~^. On the other hand, in the 
laboratory reference frame the sweeping dominates the time evolution in a fixed point of 
the space and we must use as characteristic times of the processes x n (t) the sweeping times 
ri s) = L, i.e., a = 1. 



IX. APPENDIX B 

We have now all the ingredients to perform a merging of temporal and spatial properties 
of a turbulent signal in order to define stochastic processes able to reproduce in a realistic 
way both spatial and temporal fluctuations in a Lagrangian reference frame. We just have 
to merge in a proper way the two previous algorithms. 

For example, for a d-dimensional multi-affine field such as, say, one of the three components 
of a turbulent field in a Lagrangian reference frame we can use the following model: 

MM = E E a n , k (t)J^-^-). (49) 

n=l k=l V ln J 
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where the temporal dependency of a n ^{t) is chosen following the sequential algorithm while 
its spatial part are given by the dyadic structure of the non-sequential algorithm. In fl49|) we 
have used the notation fi(x, t) in order to stress the typical Lagrangian character of such a 



We are now also able to guess a good candidate for the same field measured in the laboratory- 
reference frame, i.e. where the time properties are dominated by the sweeping of small scales 
by large scales. Indeed, it is enough to physically reproduce the sweeping effects by allowing 
the centre of the wavelets-like functions used to mimic the eddies-like turbulent structures 
to move according a swept-dynamics. 
To do so, let us define the Eulerian model: 



where the difference with the previous definition is in the temporal dependency of the cen- 
tres of the wavelets, ^ n ^{t). According to the Richardson-Kolmogorov cascade picture, one 
assumes that sweeping is present, i.e., x ni fc = x„,_x,&' +r n fc where (n, k') labels the "mother" 
of the (n, /c)-eddy and r nt k is a stochastic vector which depends on r n -i } k> and evolves with 
characteristic time r n oc (£ n ) 1- '*- Furthermore, its norm is 0(£ n ): c\ < \r nt k\/£ n < c 2 where 
Ci and c 2 are constants of order one. 

We now see that if we measure in one fixed spatial point a fluctuations over a time delay 
5t, is like to measure a simultaneous fluctuations at scale separation R = U 5t, i.e. due 
to the sweeping the main contribution to the sum will be given by the terms with scale- 
index n = \og 2 (R = Uo5t) while the temporal dependency of the coefficients a n ^{t) will 
be practically frozen on that time scale. This happens because in presence of the sweep- 
ing the main contribution is given by the displacement of the centre at large scale, i.e. 
5r = \r Q (t + 8t) — r (t)\ ~ U 6t, and the eddy turnover time at scale £ n is 0((£ n ) 1_, ») always 
large that the sweeping time 0(£ n ) at the same scale. 

In the previous discussion for sake of simplicity we did not consider the incompressibil- 
ity condition. However one can take into account this constraint by the projection on the 
solenoidal space. 

In conclusion we have a way to build up a synthetic signal with the proper Eulerian (labo- 
ratory) properties, i.e. with sweeping, and also with the proper Lagrangian properties. 



field. 




(50) 
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FIG. 1. Sketch of the coding procedure described in Section II. On the given (e, rj-grid the 
symbolic sequence is Wq (e, r) = (1, 2, 2, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 3, 3, 3, 3, 3, 4, 4, 5, 5, 5). 
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E 

FIG. 2. Numerically evaluated (e, r)-entropy for the map (||) with p = 0.8 computed with the 
Grassberger-Procaccia algorithm [6] at r = 1 (o), r = 10 (A) and r = 100 (v) and different block 
length (n = 4,8, 12,20). The boxes (□) give the entropy computed with r = 1 by using periodic 
boundary condition over 40 cells. The latter is necessary in order to compute the Lyapunov 
exponent A = fiKS = 1.15. The straight lines correspond to the two asymptotic behaviours, 
h(e) = hfcs and h(e) ~ e~ 2 . 
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FIG. 3. The same signal as in Fig. 1, with the exit-time 
coding of the same precision e. The symbolic sequence obtained with the exit time method is 
fig 7 = [(h, -1); (t 2 , -1); (i 3 , -1); (U, -1); (t 5 , -1); (i 6 , -1); (t 7 , -1); (t 8) -1)]. 
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FIG. 4. Numerically computed lower bound (□) and upper bound (with r = 1) (o) of h(e) 
according to Eq. Qi~4]), for the map (^j with the same parameters as in Fig. |2[ The two straight 
lines correspond to the asymptotic behaviours as in Fig. ^. The crosses (x) mark the values of the 
(e, r)-entropy h n (e, r)/(t(e)) with r = 0.1 (i(e)}. 
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FIG. 5. Typical evolution of the intermittent map (17) for z = 2.5 and a = 0.5. 
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FIG. 6. (t(e)) N versus N for the intermittent map (0) at e = 0.001 (left) and e = 0.243 (right) 
for different z and a = 0.5. The straight lines indicate the power law (]20|). The average (t(e))jv has 
been obtained by averaging over 10 4 different trajectories of length N, this average is necessary 
because of the poor statistics caused by the singularity near the origin. For z < 2, (i(e))jv does 
not depend on N, p(x) is normalisable, the motion is chaotic and H^/N is constant. 
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FIG. 7. Numerically computed lower (□) and upper bound (o) for the (e, r)-entropy in the case 
of a self-affme signal with £ = 1/3 (left) and £ = 1/4 (right), with r = 0.1(i(e)}. The two straight 
lines show the scaling e -3 and e~ 4 for the left and the right figure, respectively. 
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FIG. 8. Numerically computed lower bound (□) and upper bound (o), with r = 0.1(i(e)) for 
the (e, r)-entropy in the case of a multiaffine signal with £(3) = 1. The signal has been obtained 
with the method of Ref. [35] (see also Appendix A) using a D(£) which fits experimental data at 
large Reynolds number. The two straight lines show the theoretical scaling e~ 3 . 
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5v 

FIG. 9. Numerically computed lower bound (□) and upper bound (o), with r = 0.1(i(e)) for 
the (e, r)-entropy in the case of Lyon turbulent data (left) and Modane turbulent data (right). We 
also show (t((5u)) _1 (+) and its trivial dissipative scaling (dashed line). The full line follows 
the scaling 5t>~ 3 for the e-entropy, as predicted in Eq. (|29"|). 
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FIG. 10. Branching process for the multiplicative model (we only show the d = 1 case), as 
described in the main text. 
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FIG. 11. Sketch of the construction of the synthetic turbulent field. Circles represent symboli- 
cally the eddies on the scale n, n — 1, n — 2. The centers of the eddies are denoted by x, r indicates 
the distances between subsequent generations and the arrows hint to the sweeping motion. 



29 



